Automatic setting of zoom, aperture and  shutter speed based on scene depth map

ABSTRACT

A Depth Map (DM) is able to be utilized for many parameter settings involving cameras, camcorders and other devices. Setting parameters on the imaging device includes zoom setting, aperture setting and shutter speed setting.

FIELD OF THE INVENTION

The present invention relates to the field of imaging. Morespecifically, the present invention relates to utilizing a depth map forsetting parameters on the imaging device.

BACKGROUND OF THE INVENTION

A Depth Map (DM) is a map that associates distance from the camerasensor to a corresponding point in the scene for every single pixel.Methods of DM generation can be active: which include range sensors thatuse acoustic waves or project laser patterns or scan the scene with someother means to measure the distance from the camera, or passive such asstereoscopic systems, that use two or more cameras/lenses to acquiremultiple images of the scene and then match them in order to triangulatethe points in the scene or methods based on calculating depth fromseveral images.

SUMMARY OF THE INVENTION

A Depth Map (DM) is able to be utilized for setting parameters on theimaging device involving cameras, camcorders and other devices. Theparameters include zoom setting, aperture setting and shutter speedsetting.

In one aspect, a method implemented on a device comprises generating adepth map and utilizing the depth map to configure a parameter settingon the device. The depth map is generated using a single-lens camera.The depth map is generated by receiving a first image signal with afirst blur quantity at an image sensor after the first image signalpasses through a lens at a first position, receiving one or more secondimage signals with a second blur quantity at the image sensor after theone or more second image signals pass through the lens at a secondposition, computing a blur difference using the first blur quantity andthe second blur quantity and generating the depth map from the blurdifference. The depth map is generated using at least one of: rangesensors integrated with the device, double-lens stereoscopic cameras, asingle-lens camera with scanning focus area, a single-lens camerautilizing an approximate depth map, a single-lens camera movedhorizontally, and a movable lens and an image sensor to acquire multipleimages with different blur quantities. Configuring the parameter settingincludes configuring a zoom setting. Configuring the parameter settingincludes configuring an aperture setting. Configuring the parametersetting includes configuring a shutter speed setting. The method furthercomprises classifying a scene to assist in configuring the parametersetting comprising computing a histogram of values from the depth map,smoothing the histogram to eliminate noise, detecting a leftmost peakand a rightmost peak in the smoothed histogram, if the leftmost peak andthe rightmost peak correspond to depths greater than a landscapethreshold, then the scene is classified as a landscape, otherwise, if alocal minimum is not found between the leftmost peak and the rightmostpeak, then the scene is classified as other and otherwise, otherwise, aforeground/background threshold is determined by choosing the localminimum between the leftmost peak and the rightmost peak, and pixels areclassified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene. Theparameter setting is automatic zoom adjustment comprising classifying ascene, if the scene is classified as a landscape, incrementally zoomingout of the scene and re-classifying the depth map to maintain alandscape classification and reach a widest available zoom setting, ifthe scene is classified as containing a main object, automaticallyzooming in on the object up to object boundaries of the scene,performing aperture adjustment, performing shutter speed adjustment andupdating a focus position. The device is selected from the groupconsisting of a personal computer, a laptop computer, a computerworkstation, a server, a mainframe computer, a handheld computer, apersonal digital assistant, a cellular/mobile telephone, a smartappliance, a gaming console, a digital camera, a digital camcorder, acamera phone, an iPod®, a video player, a DVD writer/player, atelevision and a home entertainment system.

In another aspect, a system programmed in a controller in a deviceconfigured for utilizing a depth map in one or more applicationscomprises an aperture setting module configured for setting an aperturesize of the device and a shutter speed setting module configured forsetting a shutter speed of the device. The depth map is generated usingat least one of: range sensors integrated with the device, double-lensstereoscopic cameras, a single-lens camera with scanning focus area, asingle-lens camera utilizing an approximate depth map, a single-lenscamera moved horizontally, and a movable lens and an image sensor toacquire multiple images with different blur quantities. The device isselected from the group consisting of a personal computer, a laptopcomputer, a computer workstation, a server, a mainframe computer, ahandheld computer, a personal digital assistant, a cellular/mobiletelephone, a smart appliance, a gaming console, a digital camera, adigital camcorder, a camera phone, an iPod®, a video player, a DVDwriter/player, a television and a home entertainment system. In someembodiments, the depth map is generated using a single-lens camera.

In another aspect, a device comprises a memory for storing anapplication, the application configured for generating a depth map,utilizing the depth map to configure a parameter setting on the deviceand a processing component coupled to the memory, the processingcomponent configured for processing the application. The depth map isgenerated using at least one of: range sensors integrated with thedevice, double-lens stereoscopic cameras, a single-lens camera withscanning focus area, a single-lens camera utilizing an approximate depthmap, a single-lens camera moved horizontally, and a movable lens and animage sensor to acquire multiple images with different blur quantities.Utilizing the depth map to configure the parameter setting includes atleast one of configuring a zoom setting, configuring an aperture settingand configuring a shutter speed setting. The application is furtherconfigured for classifying a scene to assist in configuring theparameter setting comprising computing a histogram of values from thedepth map, smoothing the histogram to eliminate noise, detecting aleftmost peak and a rightmost peak in the smoothed histogram, if theleftmost peak and the rightmost peak correspond to depths greater than alandscape threshold, then the scene is classified as a landscape,otherwise, if a local minimum is not found between the leftmost peak andthe rightmost peak, then the scene is classified as other and otherwise,a foreground/background threshold is determined by choosing the localminimum between the leftmost peak and the rightmost peak, and pixels areclassified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene. Theparameter setting is automatic zoom adjustment comprising classifying ascene, if the scene is classified as a landscape, incrementally zoomingout of the scene and re-classifying the depth map to maintain alandscape classification and reach a widest available zoom setting, ifthe scene is classified as containing a main object, automaticallyzooming in on the object up to object boundaries of the scene,performing aperture adjustment, performing shutter speed adjustment andupdating a focus position. The device is selected from the groupconsisting of a personal computer, a laptop computer, a computerworkstation, a server, a mainframe computer, a handheld computer, apersonal digital assistant, a cellular/mobile telephone, a smartappliance, a gaming console, a digital camera, a digital camcorder, acamera phone, an iPod®, a video player, a DVD writer/player, atelevision and a home entertainment system. The device is a digitalstill camera.

In yet another aspect, a camera device comprises an image acquisitioncomponent, a memory for storing an application, the applicationconfigured for generating a depth map, utilizing the depth map toconfigure a parameter setting on the device for acquiring an image withthe image acquisition component and a processing component coupled tothe memory, the processing component configured for processing theapplication. The depth map is generated using at least one of: rangesensors integrated with the device, double-lens stereoscopic cameras, asingle-lens camera with scanning focus area, a single-lens camerautilizing an approximate depth map, a single-lens camera movedhorizontally, and a movable lens and an image sensor to acquire multipleimages with different blur quantities. The application is furtherconfigured for classifying a scene to assist in configuring theparameter setting comprising computing a histogram of values from thedepth map, smoothing the histogram to eliminate noise, detecting aleftmost peak and a rightmost peak in the smoothed histogram, if theleftmost peak and the rightmost peak correspond to depths greater than alandscape threshold, then the scene is classified as a landscape,otherwise, if a local minimum is not found between the leftmost peak andthe rightmost peak, then the scene is classified as other and otherwise,a foreground/background threshold is determined by choosing the localminimum between the leftmost peak and the rightmost peak, and pixels areclassified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene. Theparameter setting is automatic zoom adjustment comprising classifying ascene, if the scene is classified as a landscape, incrementally zoomingout of the scene and re-classifying the depth map to maintain alandscape classification and reach a widest available zoom setting, ifthe scene is classified as containing a main object, automaticallyzooming in on the object up to object boundaries of the scene,performing aperture adjustment, performing shutter speed adjustment andupdating a focus position. Utilizing the depth map to configure theparameter setting includes at least one of configuring a zoom setting,configuring an aperture setting and configuring a shutter speed setting.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a block diagram of a first stage of digital imageprocessing in cameras and camcorders, according to some embodiments.

FIG. 2 illustrates a flowchart of a method of scene classification basedon a depth map, according to some embodiments.

FIG. 3 illustrates a graph of a histogram and a smoothed histogram of adepth map, according to some embodiments.

FIG. 4 illustrates an example of using a depth map for generating abounding box of an object of interest, according to some embodiments.

FIG. 5 illustrates a flowchart of automatic zoom setting with apertureadjustment and shutter speed adjustment, according to some embodiments.

FIG. 6 illustrates an example of using a depth map for zoom setting totake a picture of a scene containing a main object of interest,according to some embodiments.

FIG. 7 illustrates an example of using a depth map for zoom setting totake a picture of a scene containing a landscape, according to someembodiments.

FIG. 8 illustrates a flowchart of automatic aperture setting withshutter speed adjustment, according to some embodiments.

FIG. 9 illustrates an example of using a depth map for aperture settingto take a picture of a scene containing a main object of interest,according to some embodiments.

FIG. 10 illustrates a flowchart of a method of utilizing a depth map toset device parameters, according to some embodiments.

FIG. 11 illustrates a block diagram of an exemplary computing deviceconfigured to set device parameters utilizing a depth map, according tosome embodiments.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

A Depth Map (DM) is able to be utilized for many applications involvingcameras, camcorders and other devices. There are various ways ofgenerating a DM. Some examples of methods of generating a DM includerange sensors integrated with the camera, double-lens stereoscopiccameras, a single-lens camera with scanning focus area, a single-lenscamera utilizing an approximate DM for auto focus, a single-lens cameramoved horizontally and other implementations. Another specificimplementation of determining a DM is described in U.S. patentapplication Ser. No. 11/473,694, entitled, METHOD OF AND APPARATUS FORGENERATING A DEPTH MAP UTILIZED IN AUTOFOCUSING, which is incorporatedby reference herein, which includes utilizing a movable lens and animage sensor. The depth information is acquired by moving the lens ashort distance and acquiring multiple images with different blurquantities and then using the acquired information to compute the DM.Another implementation includes utilizing capturing and generatingmultiple blurred images as described in U.S. patent application Ser. No.11/357,631, entitled, METHOD OF AND APPARATUS FOR SIMULTANEOUSLYCAPTURING AND GENERATING MULTIPLE BLURRED IMAGES, which is incorporatedby reference herein. Regardless of how the DM is acquired, theapplications described herein are able to utilize the DM.

A specific implementation for generating a dense depth map is describedby patent application Ser. No. 12/931,293, entitled, “METHOD ANDAPPARATUS FOR GENERATING A DENSE DEPTH MAP USING AN ADAPTIVE JOINTBILATERAL FILTER,” which is incorporated by reference herein. Such amethod to generate a dense depth map is able to be used to enhance thespatial and depth resolution of an existing coarse depth map which isgenerally what is available from most currently available methods of DMgeneration.

FIG. 1 illustrates a block diagram of a first stage of digital imageprocessing in cameras and camcorders according to some embodiments. Inthe step 100, camera parameter settings are able to be configured.Examples of parameter settings include, but are not limited to, zoomsetting, aperture setting and shutter speed setting. Setting the shutterspeed is an indirect byproduct of the automatic zoom setting or theaperture setting. The camera parameter settings are able to benefit fromthe information of the DM.

Perform Scene Classification Based on DM

FIG. 2 illustrates a flowchart of a method of scene classification basedon a depth map, according to some embodiments. In the step 200, ahistogram of DM values in a DM range from 0 to MaxDistance is computed.MaxDistance is the maximum measurable distance in the depth map. Thisvalue depends on the method or device used to acquire or calculate thedepth map. In the step 202, the histogram is smoothed with a 1-DGaussian filter of large variance. The purpose of this step is toeliminate noise (little variations) in the depth map histogram. Theactual variance of this filter is adjusted according to the method ordevice used to acquire or calculate the depth map. As an example, avariance=5 was used for histograms of 256 bins with depth map of about400,000 pixels computed using blur difference. Any method of computing adepth map using a difference in blur is able to be used such as themethod described in U.S. patent application Ser. No. 11/357,631, filedon Feb. 16, 2006 and titled, “METHOD OF AND APPARATUS FOR SIMULTANEOUSLYCAPTURING AND GENERATING MULTIPLE BLURRED IMAGES,” which is incorporatedby reference herein in its entirety. In the step 204, a leftmost peakand a rightmost peak are detected in the smoothed histogram of the DM.The leftmost peak in histogram corresponds to foreground area while therightmost peak in histogram corresponds to background area. Detectingleftmost and rightmost peaks is able to be achieved by analyzing thegradient in the smoothed histogram of DM. In the step 206, if bothleftmost peak and rightmost peak of the smoothed histogram correspond todepths greater than threshold_landscape, the scene is classified as alandscape in the step 208 and scene classification ends. Otherwise, theprocess continues looking for object of interest. In the step 210,segmentation of the object of interest is performed by thresholding. Inone example of thresholding, a local minima in the smoothed histogram isfound between leftmost peak and rightmost peak. If there is no localminimum, classify scene as “other” and end scene classification. Ifseveral local minima are within a certain threshold of the globalminimum between the leftmost and rightmost peak, the local minimum valuethat corresponds to the lowest depth (this is the leftmost localminimum) is chosen. The chosen local minimum corresponds toforeground/background depth threshold. If no local minimum was found,the scene is classified as “other” and scene classification ends.Thresholding is performed on the smoothed histogram of the depth map byclassifying as foreground locations with depth value lower than thethreshold and classifying as background locations with depth valuegreater than or equal to the threshold. A bounding box of object ofinterest in the image is computed by looking for min x, min y, max x,max y of image locations with a depth corresponding to foreground ascomputed in the previous step. Although one example of thresholding isdescribed, other implementations are possible.

Additional details of depth map thresholding of some embodiments aredescribed herein. In the first step, a histogram H of the depth map iscomputed. For example, 256 bins are used. In the second step, a smoothedhistogram (SH) is computed by convolving histogram H with a 1D Gaussian.For example, a 1D Gaussian with standard deviation 0.5 for histogramswith 256 bins is used. SH=H{circle around (×)}G. In the third step, afirst derivative of a smoothed histogram is computed. For example,computing the derivative using central differences:D(i)=[SH(i+1)−SH(i−1)]/2. In the fourth step, the local minima andmaxima in a smoothed histogram are computed by finding zero values inthe first derivative. For example, L={i, D(i)<tolerance_zero}, wheretolerance_zero is 0.02*total pixels/total_bins. In the fifth step,Leftmost_peak, Rightmost_peak and the threshold are computed. Forexample, Leftmost_peak=min {i, iεL}, Rightmost_peak=max {i, iεL},threshold={d, HS(d)=min {HS(i)}, Leftmost_peak≦d≦Rightmost_peak}. If nothreshold satisfies the above condition, the scene does not contain anobject of interest. If multiple thresholds satisfy the condition, thelowest threshold is chosen and the scene is classified as containing anobject of interest.

FIG. 3 illustrates a graph of a histogram and a smoothed histogram of adepth map, according to some embodiments. In the smoothed histogram ofthe depth map, the leftmost peak of the histogram is the foreground areaand the rightmost peak is the background. A foreground/background depththreshold is located at the minimum value of the histogram between theleftmost peak and the rightmost peak.

FIG. 4 illustrates an example of using a depth map for generating abounding box of an object of interest, according to some embodiments.Initially, a depth map with a main object of interest and a backgroundis shown. Then, the detected object of interest is selected and thebackground is removed. A bounding box of object of interest is generatedaround the detected object of interest.

Described herein is a method of classifying pixels in a depth map basedon depth compared to a threshold level. F is a set of foreground pixels,and B is a set of background pixels.

F={(x,y),DM(x,y)<threshold}

B={(x,y),DM(x,y)≦threshold}

Bounding box of an object of interest is defined by startxF, startyF,endxF, endyF:

startxF=min{x,(x,y)εF}

startyF=min{y,(x,y)εF}

endxF=max{x,(x,y)εF}

endyF=max{y,(x,y)εF}

The scene contains an object of interest if startxF>minxF andstartyF>minyF and endxF<maxxF and endyF<maxyF. Otherwise, the scene doesnot contain an object of interest.

Automatic Zoom Adjustment

FIG. 5 illustrates a flowchart of automatic zoom adjustment, accordingto some embodiments. Scene classification occurs in the step 500. Thenit is determined if the scene is classified as a landscape, in the step502. If the scene is classified as a landscape, image composition isable to be enhanced by incremental automatic zooming out, in the step504. Since zooming out introduces new content in the scene from theperiphery, zooming out is able to be performed in incremental stepswhile the DM is being re-classified after each step in order to ensurethat scene classification as landscape is being maintained during thezooming out process. In particular, it is determined if the widest zoomsetting available has been reached in the step 506. If the widest zoomsetting available has been reached, then the process continues in thestep 518. However, if the widest zoom setting available has not beenreached, then the depth map is re-computed, in the step 508. In the step510, scene classification based on the depth map occurs again. In thestep 512, it is determined if the scene still represents a landscape. Ifthe scene still represents a landscape, then the process resumes zoomingout, in the step 504. If the scene does not represent a landscape, thenthe process jumps to aperture adjustment, in the step 518.

If the scene is classified as containing a main object in the step 514,image composition is able to be enhanced by automatic zooming in on theobject of interest up to the object of interest boundaries in theoriginal scene, in the step 516. After the automatic zoom adjustmentprocess is completed, aperture adjustment is performed, in the step 518and shutter speed adjustment is performed, in the step 520. The apertureadjustment and the shutter speed adjustment are used to compensate forchanges in the widest available aperture for certain types of lenses.

After the adjustments, if the focus lens position was already computed,this focus position is able to be updated in order to reflect changes inthe scene depth of field as a result of changing zoom setting, in thestep 522.

An example of automatic zoom adjustment with a main object of interestis shown in FIG. 6. In FIG. 6, the closest object and the background aredetermined using the DM, then zoom is able to occur when the object isthe only object other than the background, so that a close-up picture isable to be taken of the object.

An example of automatic zoom adjustment with a landscape is shown inFIG. 7. An initial depth map is determined, for a picture at a currentzoom, but as the process zooms out, a final depth map is generated and afinal zoomed out picture is generated as described above.

Automatic Aperture/Shutter Speed Adjustment

FIG. 8 illustrates a flowchart of automatic aperture/shutter speedadjustment, according to some embodiments. In the step 800, sceneclassification based on a depth map occurs. If the scene is classifiedas representing a landscape in the step 802, image composition is ableto be enhanced by automatically setting the aperture to the narrowestavailable setting for the current zoom position, in the step 804. Theresulting image will have enhanced depth of field, suitable forlandscape photography. Afterwards, the process jumps to the step 810.

If the scene is classified as containing a main object, in the step 806,image composition is able to be enhanced by setting an aperture to awidest available setting for the current zoom position, in the step 808.The resulting shallow depth of field in the final image will enhance thedepth separation between the main object and the rest of the scene.

In the step 810, the shutter speed is adjusted. If the scene isclassified as containing a main object of interest, then the shutterspeed is increased accordingly to maintain the same exposure level forthe final image. If the scene is classified as containing a landscape,the shutter speed is decreased accordingly to maintain the same exposurelevel for the final image.

After the automatic aperture/shutter speed adjustment process iscompleted, if the focus lens position was already computed, this focusposition is able to be updated in order to reflect changes in the scenedepth of field as a result of changing the aperture setting, in the step812.

FIG. 9 illustrates an example of using a depth map for aperture settingto take a picture of a scene containing a main object of interest,according to some embodiments. In FIG. 9, the closest object and thebackground are determined using the DM, then aperture adjustment is ableto occur when the object is the only object other than the background,so that a close-up picture is able to be taken of the object.

FIG. 10 illustrates a flowchart of a method of utilizing a DM to setcamera parameters, according to some embodiments. In the step 1000, a DMis generated. As described above, the DM is able to be generated in anumber of different ways. In the step 1002, the DM is stored. In someembodiments, the DM is copied with an image for post processing. In someembodiments, the DM is not stored and the step 1002 is able to beskipped. In the step 1004, the DM is utilized to set camera parameterssuch as those described above.

FIG. 11 illustrates a block diagram of an exemplary computing device1100 configured to implement applications utilizing a DM, according tosome embodiments. The computing device 1100 is able to be used toacquire, store, compute, communicate and/or display information such asimages and videos. For example, a computing device 1100 is able toacquire and store a picture. The applications utilizing the DM are ableto be used in configuring the device 1100 to acquire an image, inacquiring the image or after the image is acquired. In general, ahardware structure suitable for implementing the computing device 1100includes a network interface 1102, a memory 1104, a processor 1106, I/Odevice(s) 1108, a bus 1110 and a storage device 1112. The choice ofprocessor is not critical as long as a suitable processor withsufficient speed is chosen. The memory 1104 is able to be anyconventional computer memory known in the art. The storage device 1112is able to include a hard drive, CDROM, CDRW, DVD, DVDRW, flash memorycard or any other storage device. The computing device 1100 is able toinclude one or more network interfaces 1102. An example of a networkinterface includes a network card connected to an Ethernet or other typeof LAN. The I/O device(s) 1108 are able to include one or more of thefollowing: keyboard, mouse, monitor, display, printer, modem,touchscreen, button interface and other devices. DM parameter settingmodule(s) 1130 used to perform the DM methods are likely to be stored inthe storage device 1112 and memory 1104 and processed as modules aretypically processed. More or less components shown in FIG. 11 are ableto be included in the computing device 1100. In some embodiments, DMprocessing or storage hardware 1120 is included. Although the computingdevice 1100 in FIG. 11 includes parameter setting modules 1130 andhardware 1120 for DM parameter setting modules, the DM parameter settingmodules are able to be implemented on a computing device in hardware,firmware, software or any combination thereof.

In some embodiments, the DM parameter setting module(s) 1130 includeadditional modules. In some embodiments, the DM parameter settingmodule(s) 1130 include a zoom setting module 1132 configured for settingthe zoom, an aperture setting module 1134 configured for setting theaperture size and a shutter speed setting module 1136 configured forsetting the shutter speed.

Examples of suitable computing devices include a personal computer, alaptop computer, a computer workstation, a server, a mainframe computer,a handheld computer, a personal digital assistant, a cellular/mobiletelephone, a smart appliance, a gaming console, a digital camera, adigital camcorder, a camera phone, an iPod®, a video player, a DVDwriter/player, a television, a home entertainment system or any othersuitable computing device.

Before an image/video is acquired, the DM is able to be utilized to setparameters including, but not limited to, zoom setting, aperture settingand shutter speed.

In operation, image acquisition is able to be improved by camerasettings being configured appropriately before the image/video isacquired.

Some Embodiments of Automatic Setting of Zoom, Aperture and ShutterSpeed Setting Based on Scene Depth Map

1. A method implemented on a device comprising:

a. generating a depth map; and

b. utilizing the depth map to configure a parameter setting on thedevice.

2. The method of clause 1 wherein the depth map is generated using asingle-lens camera.3. The method of clause 2 wherein the depth map is generated by:

a. receiving a first image signal with a first blur quantity at an imagesensor after the first image signal passes through a lens at a firstposition;

b. receiving one or more second image signals with a second blurquantity at the image sensor after the one or more second image signalspass through the lens at a second position;

c. computing a blur difference using the first blur quantity and thesecond blur quantity; and

d. generating the depth map from the blur difference.

4. The method of clause 1 wherein the depth map is generated using atleast one of: range sensors integrated with the device, double-lensstereoscopic cameras, a single-lens camera with scanning focus area, asingle-lens camera utilizing an approximate depth map, a single-lenscamera moved horizontally, and a movable lens and an image sensor toacquire multiple images with different blur quantities.5. The method of clause 1 wherein configuring the parameter settingincludes configuring a zoom setting.6. The method of clause 1 wherein configuring the parameter settingincludes configuring an aperture setting.7. The method of clause 1 wherein configuring the parameter settingincludes configuring a shutter speed setting.8. The method of clause 1 further comprising classifying a scene toassist in configuring the parameter setting comprising:

a. computing a histogram of values from the depth map;

b. smoothing the histogram to eliminate noise;

c. detecting a leftmost peak and a rightmost peak in the smoothedhistogram;

d. if the leftmost peak and the rightmost peak correspond to depthsgreater than a landscape threshold, then the scene is classified as alandscape;

e. otherwise, if a local minimum is not found between the leftmost peakand the rightmost peak, then the scene is classified as other; and

f. otherwise, a foreground/background threshold is determined bychoosing the local minimum between the leftmost peak and the rightmostpeak, and pixels are classified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene.

9. The method of clause 1 wherein the parameter setting is automaticzoom adjustment comprising:

a. classifying a scene;

b. if the scene is classified as a landscape, incrementally zooming outof the scene and re-classifying the depth map to maintain a landscapeclassification and reach a widest available zoom setting;

c. if the scene is classified as containing a main object, automaticallyzooming in on the object up to object boundaries of the scene;

d. performing aperture adjustment;

e. performing shutter speed adjustment; and

f. updating a focus position.

10. The method of clause 1 wherein the device is selected from the groupconsisting of a personal computer, a laptop computer, a computerworkstation, a server, a mainframe computer, a handheld computer, apersonal digital assistant, a cellular/mobile telephone, a smartappliance, a gaming console, a digital camera, a digital camcorder, acamera phone, an iPod®, a video player, a DVD writer/player, atelevision and a home entertainment system.11. A system programmed in a controller in a device configured forutilizing a depth map in one or more applications comprising:

a. an aperture setting module configured for setting an aperture size ofthe device; and

b. a shutter speed setting module configured for setting a shutter speedof the device.

12. The system of clause 11 wherein the depth map is generated using atleast one of: range sensors integrated with the device, double-lensstereoscopic cameras, a single-lens camera with scanning focus area, asingle-lens camera utilizing an approximate depth map, a single-lenscamera moved horizontally, and a movable lens and an image sensor toacquire multiple images with different blur quantities.13. The system of clause 11 wherein the device is selected from thegroup consisting of a personal computer, a laptop computer, a computerworkstation, a server, a mainframe computer, a handheld computer, apersonal digital assistant, a cellular/mobile telephone, a smartappliance, a gaming console, a digital camera, a digital camcorder, acamera phone, an iPod®, a video player, a DVD writer/player, atelevision and a home entertainment system.14. The system of clause 11 wherein the depth map is generated using asingle-lens camera.15. A device comprising:

a. a memory for storing an application, the application configured for:

-   -   i. generating a depth map;    -   ii. utilizing the depth map to configure a parameter setting on        the device; and

b. a processing component coupled to the memory, the processingcomponent configured for processing the application.

16. The device of clause 15 wherein the depth map is generated using atleast one of: range sensors integrated with the device, double-lensstereoscopic cameras, a single-lens camera with scanning focus area, asingle-lens camera utilizing an approximate depth map, a single-lenscamera moved horizontally, and a movable lens and an image sensor toacquire multiple images with different blur quantities.17. The device of clause 15 wherein utilizing the depth map to configurethe parameter setting includes at least one of configuring a zoomsetting, configuring an aperture setting and configuring a shutter speedsetting.18. The device of clause 15 wherein the aperture is further configuredfor classifying a scene to assist in configuring the parameter settingcomprising:

a. computing a histogram of values from the depth map;

b. smoothing the histogram to eliminate noise;

c. detecting a leftmost peak and a rightmost peak in the smoothedhistogram;

d. if the leftmost peak and the rightmost peak correspond to depthsgreater than a landscape threshold, then the scene is classified as alandscape;

e. otherwise, if a local minimum is not found between the leftmost peakand the rightmost peak, then the scene is classified as other; and

f. otherwise, a foreground/background threshold is determined bychoosing the local minimum between the leftmost peak and the rightmostpeak, and pixels are classified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene.

19. The device of clause 15 wherein the parameter setting is automaticzoom adjustment comprising:

a. classifying a scene;

b. if the scene is classified as a landscape, incrementally zooming outof the scene and re-classifying the depth map to maintain a landscapeclassification and reach a widest available zoom setting;

c. if the scene is classified as containing a main object, automaticallyzooming in on the object up to object boundaries of the scene;

d. performing aperture adjustment;

e. performing shutter speed adjustment; and

f. updating a focus position.

20. The device of clause 15 wherein the device is selected from thegroup consisting of a personal computer, a laptop computer, a computerworkstation, a server, a mainframe computer, a handheld computer, apersonal digital assistant, a cellular/mobile telephone, a smartappliance, a gaming console, a digital camera, a digital camcorder, acamera phone, an iPod®, a video player, a DVD writer/player, atelevision and a home entertainment system.21. The device of clause 15 wherein the device is a digital stillcamera.22. A camera device comprising:

a. an image acquisition component;

b. a memory for storing an application, the application configured for:

-   -   i. generating a depth map;    -   ii. utilizing the depth map to configure a parameter setting on        the device for acquiring an image with the image acquisition        component; and

c. a processing component coupled to the memory, the processingcomponent configured for processing the application.

23. The camera device of clause 22 wherein the depth map is generatedusing at least one of: range sensors integrated with the device,double-lens stereoscopic cameras, a single-lens camera with scanningfocus area, a single-lens camera utilizing an approximate depth map, asingle-lens camera moved horizontally, and a movable lens and an imagesensor to acquire multiple images with different blur quantities.24. The camera device of clause 22 wherein utilizing the depth map toconfigure the parameter setting includes at least one of configuring azoom setting, configuring an aperture setting and configuring a shutterspeed setting.25. The camera device of clause 22 wherein the application is furtherconfigured for classifying a scene to assist in configuring theparameter setting comprising:

a. computing a histogram of values from the depth map;

b. smoothing the histogram to eliminate noise;

c. detecting a leftmost peak and a rightmost peak in the smoothedhistogram;

d. if the leftmost peak and the rightmost peak correspond to depthsgreater than a landscape threshold, then the scene is classified as alandscape;

e. otherwise, if a local minimum is not found between the leftmost peakand the rightmost peak, then the scene is classified as other; and

f. otherwise, a foreground/background threshold is determined bychoosing the local minimum between the leftmost peak and the rightmostpeak, and pixels are classified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene.

26. The camera device of clause 22 wherein the parameter setting isautomatic zoom adjustment comprising:

a. classifying a scene;

b. if the scene is classified as a landscape, incrementally zooming outof the scene and re-classifying the depth map to maintain a landscapeclassification and reach a widest available zoom setting;

c. if the scene is classified as containing a main object, automaticallyzooming in on the object up to object boundaries of the scene;

d. performing aperture adjustment;

e. performing shutter speed adjustment; and

f. updating a focus position.

The present invention has been described in terms of specificembodiments incorporating details to facilitate the understanding ofprinciples of construction and operation of the invention. Suchreference herein to specific embodiments and details thereof is notintended to limit the scope of the claims appended hereto. It will bereadily apparent to one skilled in the art that other variousmodifications may be made in the embodiment chosen for illustrationwithout departing from the spirit and scope of the invention as definedby the claims.

1. A method implemented on a device comprising: a. generating a depthmap; and b. utilizing the depth map to configure a parameter setting onthe device.
 2. The method of claim 1 wherein the depth map is generatedusing a single-lens camera.
 3. The method of claim 2 wherein the depthmap is generated by: a. receiving a first image signal with a first blurquantity at an image sensor after the first image signal passes througha lens at a first position; b. receiving one or more second imagesignals with a second blur quantity at the image sensor after the one ormore second image signals pass through the lens at a second position; c.computing a blur difference using the first blur quantity and the secondblur quantity; and d. generating the depth map from the blur difference.4. The method of claim 1 wherein the depth map is generated using atleast one of: range sensors integrated with the device, double-lensstereoscopic cameras, a single-lens camera with scanning focus area, asingle-lens camera utilizing an approximate depth map, a single-lenscamera moved horizontally, and a movable lens and an image sensor toacquire multiple images with different blur quantities.
 5. The method ofclaim 1 wherein configuring the parameter setting includes configuring azoom setting.
 6. The method of claim 1 wherein configuring the parametersetting includes configuring an aperture setting.
 7. The method of claim1 wherein configuring the parameter setting includes configuring ashutter speed setting.
 8. The method of claim 1 further comprisingclassifying a scene to assist in configuring the parameter settingcomprising: a. computing a histogram of values from the depth map; b.smoothing the histogram to eliminate noise; c. detecting a leftmost peakand a rightmost peak in the smoothed histogram; d. if the leftmost peakand the rightmost peak correspond to depths greater than a landscapethreshold, then the scene is classified as a landscape; e. otherwise, ifa local minimum is not found between the leftmost peak and the rightmostpeak, then the scene is classified as other; and f. otherwise, aforeground/background threshold is determined by choosing the localminimum between the leftmost peak and the rightmost peak, and pixels areclassified as foreground or background based on theforeground/background threshold and a bounding box of foreground pixelsdetermines whether there is an object of interest in the scene.
 9. Themethod of claim 1 wherein the parameter setting is automatic zoomadjustment comprising: a. classifying a scene; b. if the scene isclassified as a landscape, incrementally zooming out of the scene andre-classifying the depth map to maintain a landscape classification andreach a widest available zoom setting; c. if the scene is classified ascontaining a main object, automatically zooming in on the object up toobject boundaries of the scene; d. performing aperture adjustment; e.performing shutter speed adjustment; and f. updating a focus position.10. The method of claim 1 wherein the device is selected from the groupconsisting of a personal computer, a laptop computer, a computerworkstation, a server, a mainframe computer, a handheld computer, apersonal digital assistant, a cellular/mobile telephone, a smartappliance, a gaming console, a digital camera, a digital camcorder, acamera phone, an iPod®, a video player, a DVD writer/player, atelevision and a home entertainment system.
 11. A system programmed in acontroller in a device configured for utilizing a depth map in one ormore applications comprising: a. an aperture setting module configuredfor setting an aperture size of the device; and b. a shutter speedsetting module configured for setting a shutter speed of the device. 12.The system of claim 11 wherein the depth map is generated using at leastone of: range sensors integrated with the device, double-lensstereoscopic cameras, a single-lens camera with scanning focus area, asingle-lens camera utilizing an approximate depth map, a single-lenscamera moved horizontally, and a movable lens and an image sensor toacquire multiple images with different blur quantities.
 13. The systemof claim 11 wherein the device is selected from the group consisting ofa personal computer, a laptop computer, a computer workstation, aserver, a mainframe computer, a handheld computer, a personal digitalassistant, a cellular/mobile telephone, a smart appliance, a gamingconsole, a digital camera, a digital camcorder, a camera phone, aniPod®, a video player, a DVD writer/player, a television and a homeentertainment system.
 14. The system of claim 11 wherein the depth mapis generated using a single-lens camera.
 15. A device comprising: a. amemory for storing an application, the application configured for: i.generating a depth map; ii. utilizing the depth map to configure aparameter setting on the device; and b. a processing component coupledto the memory, the processing component configured for processing theapplication.
 16. The device of claim 15 wherein the depth map isgenerated using at least one of: range sensors integrated with thedevice, double-lens stereoscopic cameras, a single-lens camera withscanning focus area, a single-lens camera utilizing an approximate depthmap, a single-lens camera moved horizontally, and a movable lens and animage sensor to acquire multiple images with different blur quantities.17. The device of claim 15 wherein utilizing the depth map to configurethe parameter setting includes at least one of configuring a zoomsetting, configuring an aperture setting and configuring a shutter speedsetting.
 18. The device of claim 15 wherein the aperture is furtherconfigured for classifying a scene to assist in configuring theparameter setting comprising: a. computing a histogram of values fromthe depth map; b. smoothing the histogram to eliminate noise; c.detecting a leftmost peak and a rightmost peak in the smoothedhistogram; d. if the leftmost peak and the rightmost peak correspond todepths greater than a landscape threshold, then the scene is classifiedas a landscape; e. otherwise, if a local minimum is not found betweenthe leftmost peak and the rightmost peak, then the scene is classifiedas other; and f. otherwise, a foreground/background threshold isdetermined by choosing the local minimum between the leftmost peak andthe rightmost peak, and pixels are classified as foreground orbackground based on the foreground/background threshold and a boundingbox of foreground pixels determines whether there is an object ofinterest in the scene.
 19. The device of claim 15 wherein the parametersetting is automatic zoom adjustment comprising: a. classifying a scene;b. if the scene is classified as a landscape, incrementally zooming outof the scene and re-classifying the depth map to maintain a landscapeclassification and reach a widest available zoom setting; c. if thescene is classified as containing a main object, automatically zoomingin on the object up to object boundaries of the scene; d. performingaperture adjustment; e. performing shutter speed adjustment; and f.updating a focus position.
 20. The device of claim 15 wherein the deviceis selected from the group consisting of a personal computer, a laptopcomputer, a computer workstation, a server, a mainframe computer, ahandheld computer, a personal digital assistant, a cellular/mobiletelephone, a smart appliance, a gaming console, a digital camera, adigital camcorder, a camera phone, an iPod®, a video player, a DVDwriter/player, a television and a home entertainment system.
 21. Thedevice of claim 15 wherein the device is a digital still camera.
 22. Acamera device comprising: a. an image acquisition component; b. a memoryfor storing an application, the application configured for: i.generating a depth map; ii. utilizing the depth map to configure aparameter setting on the device for acquiring an image with the imageacquisition component; and c. a processing component coupled to thememory, the processing component configured for processing theapplication.
 23. The camera device of claim 22 wherein the depth map isgenerated using at least one of: range sensors integrated with thedevice, double-lens stereoscopic cameras, a single-lens camera withscanning focus area, a single-lens camera utilizing an approximate depthmap, a single-lens camera moved horizontally, and a movable lens and animage sensor to acquire multiple images with different blur quantities.24. The camera device of claim 22 wherein utilizing the depth map toconfigure the parameter setting includes at least one of configuring azoom setting, configuring an aperture setting and configuring a shutterspeed setting.
 25. The camera device of claim 22 wherein the applicationis further configured for classifying a scene to assist in configuringthe parameter setting comprising: a. computing a histogram of valuesfrom the depth map; b. smoothing the histogram to eliminate noise; c.detecting a leftmost peak and a rightmost peak in the smoothedhistogram; d. if the leftmost peak and the rightmost peak correspond todepths greater than a landscape threshold, then the scene is classifiedas a landscape; e. otherwise, if a local minimum is not found betweenthe leftmost peak and the rightmost peak, then the scene is classifiedas other; and f. otherwise, a foreground/background threshold isdetermined by choosing the local minimum between the leftmost peak andthe rightmost peak, and pixels are classified as foreground orbackground based on the foreground/background threshold and a boundingbox of foreground pixels determines whether there is an object ofinterest in the scene.
 26. The camera device of claim 22 wherein theparameter setting is automatic zoom adjustment comprising: a.classifying a scene; b. if the scene is classified as a landscape,incrementally zooming out of the scene and re-classifying the depth mapto maintain a landscape classification and reach a widest available zoomsetting; c. if the scene is classified as containing a main object,automatically zooming in on the object up to object boundaries of thescene; d. performing aperture adjustment; e. performing shutter speedadjustment; and f. updating a focus position.